Noncontact measurement of emotional and physiological changes in heart rate from a webcam

Heart rate, measured in beats per minute (BPM), can be used as an index of an individual's physiological state. Each time the heart beats, blood is expelled and travels through the body. This blood flow can be detected in the face using a standard webcam that is able to pick up subtle changes in color that cannot be seen by the naked eye. Due to the light absorption spectrum of blood, we are able to detect differences in the amount of light absorbed by the blood traveling just below the skin (i.e., photoplethysmography). By modulating emotional and physiological stress -- i.e., viewing arousing images and sitting vs. standing, respectively -- to elicit changes in heart rate, we explored the feasibility of using a webcam as a psychophysiological measurement of autonomic activity. We found a high level of agreement between established physiological measures, electrocardiogram (ECG), and blood pulse oximetry, and heart rate estimates obtained from the webcam. We thus suggest webcams can be used as a non-invasive and readily available method for measuring psychophysiological changes, easily integrated into existing stimulus presentation software and hardware setups

Noncontact measurement of emotional and physiological changes in heart rate from a webcam

Heart rate, measured in beats per minute (BPM), can be used as an index of an individual's physiological state. Each time the heart beats, blood is expelled and travels through the body. This blood flow can be detected in the face using a standard webcam that is able to pick up subtle changes in color that cannot be seen by the naked eye. Due to the light absorption spectrum of blood, we are able to detect differences in the amount of light absorbed by the blood traveling just below the skin (i.e., photoplethysmography). By modulating emotional and physiological stress -- i.e., viewing arousing images and sitting vs. standing, respectively -- to elicit changes in heart rate, we explored the feasibility of using a webcam as a psychophysiological measurement of autonomic activity. We found a high level of agreement between established physiological measures, electrocardiogram (ECG), and blood pulse oximetry, and heart rate estimates obtained from the webcam. We thus suggest webcams can be used as a non-invasive and readily available method for measuring psychophysiological changes, easily integrated into existing stimulus presentation software and hardware setups

To See or Not to See: Prestimulus α Phase Predicts Visual Awareness

We often fail to see something that at other times is readily detectable. Because the visual stimulus itself is unchanged, this variability in conscious awareness is likely related to changes in the brain. Here we show that the phase of EEG α rhythm measured over posterior brain regions can reliably predict both subsequent visual detection and stimulus-elicited cortical activation levels in a metacontrast masking paradigm. When a visual target presentation coincides with the trough of an α wave, cortical activation is suppressed as early as 100 ms after stimulus onset, and observers are less likely to detect the target. Thus, during one α cycle lasting 100 ms, the human brain goes through a rapid oscillation in excitability, which directly influences the probability that an environmental stimulus will reach conscious awareness. Moreover, ERPs to the appearance of a fixation cross before the target predict its detection, further suggesting that cortical excitability level may mediate target detection. A novel theory of cortical inhibition is proposed in which increased α power represents a “pulsed inhibition” of cortical activity that affects visual awareness

Pulsed out of awareness: EEG alpha oscillations represent a pulsed-inhibition of ongoing cortical processing

Alpha oscillations are ubiquitous in the brain, but their role in cortical processing remains a matter of debate. Recently, evidence has begun to accumulate in support of a role for alpha oscillations in attention selection and control. Here we first review evidence that 8–12 Hz oscillations in the brain have a general inhibitory role in cognitive processing, with an emphasis on their role in visual processing. Then, we summarize the evidence in support of our recent proposal that alpha represents a pulsed-inhibition of ongoing neural activity. The phase of the ongoing electroencephalography can influence evoked activity and subsequent processing, and we propose that alpha exerts its inhibitory role through alternating microstates of inhibition and excitation. Finally, we discuss evidence that this pulsed-inhibition can be entrained to rhythmic stimuli in the environment, such that preferential processing occurs for stimuli at predictable moments. The entrainment of preferential phase may provide a mechanism for temporal attention in the brain. This pulsed inhibitory account of alpha has important implications for many common cognitive phenomena, such as the attentional blink, and seems to indicate that our visual experience may at least some times be coming through in waves

Pulsed out of awareness: EEG alpha oscillations represent a pulsed-inhibition of ongoing cortical processing

Alpha oscillations are ubiquitous in the brain, but their role in cortical processing remains a matter of debate. Recently, evidence has begun to accumulate in support of a role for alpha oscillations in attention selection and control. Here we first review evidence that 8–12 Hz oscillations in the brain have a general inhibitory role in cognitive processing, with an emphasis on their role in visual processing. Then, we summarize the evidence in support of our recent proposal that alpha represents a pulsed-inhibition of ongoing neural activity. The phase of the ongoing electroencephalography can influence evoked activity and subsequent processing, and we propose that alpha exerts its inhibitory role through alternating microstates of inhibition and excitation. Finally, we discuss evidence that this pulsed-inhibition can be entrained to rhythmic stimuli in the environment, such that preferential processing occurs for stimuli at predictable moments. The entrainment of preferential phase may provide a mechanism for temporal attention in the brain. This pulsed inhibitory account of alpha has important implications for many common cognitive phenomena, such as the attentional blink, and seems to indicate that our visual experience may at least some times be coming through in waves

The time course of moral perception: an ERP investigation of the moral pop-out effect

Humans are highly attuned to perceptual cues about their values. A growing body of evidence suggests that people selectively attend to moral stimuli. However, it is unknown whether morality is prioritized early in perception or much later in cognitive processing. We use a combination of behavioral methods and electroencephalography to investigate how early in perception moral words are prioritized relative to non-moral words. The behavioral data replicate previous research indicating that people are more likely to correctly identify moral than non-moral words in a modified lexical decision task. The electroencephalography data reveal that words are distinguished from non-words as early as 200 ms after onset over frontal brain areas and moral words are distinguished from non-moral words 100 ms later over left-posterior cortex. Further analyses reveal that differences in brain activity to moral vs non-moral words cannot be explained by differences in arousal associated with the words. These results suggest that moral content might be prioritized in conscious awareness after an initial perceptual encoding but before subsequent memory processing or action preparation. This work offers a more precise theoretical framework for understanding how morality impacts vision and behavior

Dynamics of Alpha Control: Preparatory Suppression of Posterior Alpha Oscillations by Frontal Modulators Revealed with Combined EEG and Event-related Optical Signal

We investigated the dynamics of brain processes facilitating conscious experience of external stimuli. Previously, we proposed that alpha (8–12 Hz) oscillations, which fluctuate with both sustained and directed attention, represent a pulsed inhibition of ongoing sensory brain activity. Here we tested the prediction that inhibitory alpha oscillations in visual cortex are modulated by top–down signals from frontoparietal attention networks. We measured modulations in phase-coherent alpha oscillations from superficial frontal, parietal, and occipital cortices using the event-related optical signal (EROS), a measure of neuronal activity affording high spatiotemporal resolution, along with concurrently recorded EEG, while participants performed a visual target detection task. The pretarget alpha oscillations measured with EEG and EROS from posterior areas were larger for subsequently undetected targets, supporting alpha\u27s inhibitory role. Using EROS, we localized brain correlates of these awareness-related alpha oscillations measured at the scalp to the cuneus and precuneus. Crucially, EROS alpha suppression correlated with posterior EEG alpha power across participants. Sorting the EROS data based on EEG alpha power quartiles to investigate alpha modulators revealed that suppression of posterior alpha was preceded by increased activity in regions of the dorsal attention network and decreased activity in regions of the cingulo-opercular network. Cross-correlations revealed the temporal dynamics of activity within these preparatory networks before posterior alpha modulation. The novel combination of EEG and EROS afforded localization of the sources and correlates of alpha oscillations and their temporal relationships, supporting our proposal that top–down control from attention networks modulates both posterior alpha and awareness of visual stimuli

Pulsed out of awareness: EEG alpha oscillations represent a pulsed inhibition of ongoing cortical processing

Alpha oscillations are ubiquitous in the brain, but their role in cortical processing remains a matter of debate. Recently, evidence has begun to accumulate in support of a role for Alpha oscillations in attention selection and control. In this thesis, a series of studies is presented investigating the role of Alpha oscillations in visual processing, learning, and awareness. I propose that Alpha oscillations represent a general pulsed inhibition in the brain. Chapter 1 contains a review of evidence that 8-12 Hz oscillations in the brain have a general inhibitory role in cognitive processing, with an emphasis on their role in visual processing. Chapter 2 presents additional evidence for this general inhibitory role, in a study where EEG Alpha is used to predict the rate of improvement in a complex video game training program. Chapter 3 summarizes research supporting the proposal that Alpha represents a pulsed inhibition of ongoing neural activity. The phase of the ongoing EEG can influence evoked activity and subsequent processing. It is proposed that Alpha exerts its inhibitory role through alternating microstates of inhibition and excitation. Chapter 4 and Chapter 5 discuss evidence that this pulsed inhibition can be entrained to rhythmic stimuli in the environment, such that preferential processing occurs for stimuli at predictable moments, leading to oscillations in visual awareness. The entrainment of a preferential phase of ongoing Alpha oscillations may provide a mechanism for temporal attention in the brain. Chapter 6 reports the results of an experiment combining fast optical imaging using the event-related optical signal (EROS) with EEG recording in a meta-contrast masking task. This multimodal combination is used to investigate the network of brain areas oscillating at Alpha frequencies and their influence on visual awareness, as well as the frontal and parietal areas modulating this oscillatory activity. Chapter 7 concludes that together, this series of studies provides the foundation for an account of Alpha oscillations as a general pulsed inhibition mechanism which can be entrained by external stimulation and modulated by top down influences from the fronto-parietal attention network. Given the rhythmic nature of this proposed inhibitory mechanism, this pulsed inhibitory account of Alpha has important implications for many common cognitive phenomena, such as the attentional blink, and seems to indicate that our visual experience may at least some times be coming through in waves. Chapter 1 contains a review of evidence that 8-12 Hz oscillations in the brain have a general inhibitory role in cognitive processing, with an emphasis on their role in visual processing. Chapter 2 presents additional evidence for this general inhibitory role, in a study where EEG Alpha is used to predict the rate of improvement in a complex video game training program. Chapter 3 summarizes research supporting the proposal that Alpha represents a pulsed inhibition of ongoing neural activity. The phase of the ongoing EEG can influence evoked activity and subsequent processing, and it is proposed that Alpha exerts its inhibitory role through alternating microstates of inhibition and excitation. Chapter 4 and Chapter 5 discuss evidence that this pulsed inhibition can be entrained to rhythmic stimuli in the environment, such that preferential processing occurs for stimuli at predictable moments, leading to oscillations in visual awareness. The entrainment of preferential phase of ongoing Alpha oscillations may provide a mechanism for temporal attention in the brain. Chapter 6 reports the results of an experiment combining fast optical imaging using the event-related optical signal (EROS) with EEG recording in a meta-contrast masking task. This multimodal combination is used to investigate the network of brain areas oscillating at Alpha frequencies and their influence on visual awareness, as well as the frontal and parietal areas modulating this oscillatory activity. Chapter 7 concludes that together, this series of studies provides the foundation for an account of Alpha oscillations as a general pulsed inhibition mechanism which can be entrained by external stimulation and modulated by top down influences from the fronto-parietal attention network. Given the rhythmic nature of this proposed inhibitory mechanism, this pulsed inhibitory account of Alpha has important implications for many common cognitive phenomena, such as the attentional blink, and seems to indicate that our visual experience may at least some times be coming through in waves

Does 10-Hz Cathodal Oscillating Current of the Parieto-Occipital Lobe Modulate Target Detection?

The phase of alpha (8–12 Hz) brain oscillations have been associated with moment to moment changes in visual attention and awareness. Previous work has demonstrated that endogenous oscillations and subsequent behavior can be modulated by oscillating transcranial current stimulation (otCS). The purpose of the current study is to establish the efficacy of cathodal otCS for modulation of the ongoing alpha brain oscillations, allowing for modulation of individual's visual perception. Thirty-six participants performed a target detection with sham and 10-Hz cathodal otCS. Each participant had two practice and two experimental sets composed of three blocks of 128 trials per block. Stimulating electrodes were placed on the participant's head with the anode electrode at Cz and the cathode electrode at Oz. A 0.5 mA current was applied every 100 ms (10 Hz frequency) during the otCS condition. The same current and frequency was applied for the first 10–20 s of the sham condition, after which the current was turned off. Target detection rates were compared between the sham and otCS experimental conditions in order to test for effects of otCS phase on target detection. We found no significant difference in target detection rates between the sham and otCS conditions, and discuss potential reasons for the apparent inability of cathodal otCS to effectively modulate visual perception